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ABSTRACT 



The image processing apparatus has nonlinear processing 
device that performs nonlinear processing on a digital color 
signal. The nonlinear processing device comprises gray 
region discriminating device which discriminates whether 
the digital color signals are present in a gray proximate 
region including gray signals and region correspondence 
nonlinear processing device which performs the nonlinear 
processing differently in accordance with cases where the 
digital color signals are discriminated as signals inside the 
gray proximate region being present in the vicinity of the 
gray signals or as signals outside the gray proximate region 
being not present in the vicinity of the gray signals by the 
gray region discriminating device. The image processing 
apparatus realizes a three-dimensional retrieving table (3D- 
LUT) which does not cause subtle variations different from 
its aim in the output signals only with a small addition of 
memory capacity to the ordinary memory, ensuring that the 
gray reproduction can be performed consistently and that 
photographic prints of high quality are produced in succes- 
sion. 
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IMAGE PROCESSING APPARATUS 

BACKGROUND OF THE INVENTION 

This invention relates to an image processing apparatus, 
particularly one that is useful in reading the images on 
photographic films (which are hereinafter referred to simply 
as "films") to produce photographic prints in succession, 
more particularly one that is useful in reproducing a gray in 
a stable manner to produce photographic prints of high 
quality in succession. 

Heretofore, the images recorded on films such as nega- 
tives and reversals have been commonly printed on light- 
sensitive materials (photographic paper) by means of direct 
(analog) exposure in which the film image is projected onto 
the light-sensitive material to achieve its areal exposure. 

A new technology has recently been introduced and this 
is a printer that relies upon digital exposure. Briefly, the 
image recorded on a film is read photoelectrically, converted 
to digital signals and subjected to various image processing 
operations to produce image data for recording purposes; 
recording light that has been modulated in accordance with 
the image data is used to scan and expose a light-sensitive 
material to record a latent image, which is subsequently 
developed to produce a finished print. The printer operating 
on this principle has been commercialized as a digital 
printer. 

In the digital printer, images can be processed as digital 
image data to determine the exposure conditions for print- 
ing. Hence, it is capable of performing various image 
processing operations such as the correction of washed-out 
highlights or flat (dull) shadows due to the taking of pictures 
with backlight or an electronic flash, sharpening and the 
correction of color or density failures and this enables the 
production of prints of the high quality that has been 
impossible to achieve by the conventional direct exposure. 
Further, not only the assembling of images and the splitting 
of a single image into plural images but also the composition 
of characters can be performed by processing the image data 
and, as a result, prints can be outputted after various editing 
and/or processing operations have been performed in accor- 
dance with specific uses. 

Outputting images as prints is not the sole capability of 
the digital printer; the image data can be supplied into a 
computer and the like and stored in recording media such as 
a floppy disk; hence, the image data can be put to various 
non-photographic uses. 

Having these features, the digital printer is basically 
composed of an image input unit having a scanner (image 
reading apparatus) and an image processing apparatus, and 
an image output unit having a printer (image recording 
apparatus) and a processor (developer). 

In the scanner, reading light issuing from a light source is 
allowed to be incident on a film, from which projected light 
bearing the image recorded on the film is produced and 
focused by an imaging lens to form a sharp image on an 
image sensor such as a CCD sensor; the image is then 
captured by photoelectric conversion and sent to the image 
processing apparatus as data for the image on the film (as 
image data signals) after being optionally subjected to 
various image processing schemes. 

In the image processing apparatus, image processing 
conditions are set on the basis of the image data captured 
with the scanner and image processing as determined by the 
thus set conditions is performed on the captured image data 



13,409 Bl 

2 

and the resulting output image data for image recording (i.e., 
exposure conditions) are sent to the printer. 

In the printer, if it is of a type that relies upon exposure 
by scanning with an optical beam, the optical beam is 

5 modulated in accordance with the image data from the 
image processing apparatus and deflected in a main scanning 
direction as the light-sensitive material is transported in an 
auxiliary scanning direction perpendicular to the main scan- 
ning direction, whereby a latent image is formed as the result 

10 of exposure (printing) of the light-sensitive material with the 
image bearing optical beam. Then, in the processor, devel- 
opment and other processings as determined by the light- 
sensitive material are performed to produce a print repro- 
ducing the image that was recorded on the film. 

15 The image processing schemes described above generally 
include color balance adjustment, contrast correction 
(toning), lightness correction, dodging (compression/ 
extension of the dynamic range of densities), chroma cor- 
rection and sharpening. These schemes are performed by 

20 known methods comprising appropriate combinations of 
arithmetic operations with operation expressions, processing 
operations with retrieving tables, namely, look-up tables 
(LUTs), matrix (MTX) operations, processing operations 
with filters and the like. For example, color balance 

2S adjustment, lightness correction and contrast correction are 
performed with LUTs, while chroma correction is performed 
by MTX operations. Sharpening and dodging are performed 
in other processing units. 

30 In three dimensional retrieving tables, namely, 3D (3 
dimensional^LUTs which have been used in the conven- 
tional image processing technology, output signal values are 
held corresponding to respective vertexes of a cube con- 
structed with planes perpendicular to R, G and B axes and 

35 then output signal values, namely, nonlinear transformation 
values by LUTs, at a position are obtained by subjecting the 
thus held output signal values corresponding to respective 
vertexes to interpolation operations by means of weights in 
accordance with the position within the cube. However, a 

^ problem with such processing is that input signal values of 
"gray" may cause a subtle variations different from its aim 
in an output signal, unless sufficient number of planes 
perpendicular to R, G and B axes are prepared. 

In order to solve the problem, the number of planes 

45 perpendicular to R, G and B axes may be increased for 
preparing exquisite cubes. However, another problem will 
come out in this case such that output signal values corre- 
sponding to respective vertexes of huge values of cubes 
must be held. 

50 SUMMARY OF THE INVENTION 

The present invention (hereinafter called as the invention) 
has been accomplished under these circumstances and has as 
an object providing an image processing apparatus that 

55 realizes a three-dimensional retrieving table (3D-LUT) 
which does not cause subtle variations different from its aim 
in output signals only with a small addition of memory, 
capacity to the ordinary memory thereby ensuring that the 
gray reproduction can be performed consistently and that 

60 photographic prints of high quality are produced in succes- 
sion. 

The stated object of the invention can be attained by an 
image processing apparatus having nonlinear processing 
means for performing nonlinear processing on digital color 
65 signals, the nonlinear processing means comprising: gray 
region discriminating means for discriminating whether the 
digital color signals are present in a gray proximate region 
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including gray signals; and region correspondence nonlinear 
processing means for performing the nonlinear processing 
differently in accordance with cases where the digital color 
signals are discriminated as signals inside the gray proxi- 
mate region being present in the proximity of the gray 
signals or as signals outside the gray proximate region being 
not present in the proximity of the gray signals by the gray 
region discriminating means. 

It is preferable that, in the image processing apparatus, the 
region correspondence nonlinear processing means com- 
prises first processing means for calculating endpoints of a 
first interpolation unit region including the signals inside the 
gray proximate region as well as first interpolation weights 
of the signals inside the gray proximate region; second 
processing means for calculating endpoints of a second 
interpolation unit region including the signals outside the 
gray proximate region as well as second interpolation 
weights of the signals outside the gray proximate region; and 
interpolation processing means for performing interpolation 
processing using the endpoints of the first interpolation unit 
region and the first interpolation weights which have been 
calculated by the first processing means to obtain nonlinear 
processing output values of the signals inside the gray 
proximate region or for performing another interpolation 
processing using the endpoints of the second interpolation 
unit region and the second interpolation weights which have 
been calculated by the second interpolation processing 
means to obtain nonlinear processing output values of the 
signals outside the gray proximate region. 

It is also preferable that the first processing means com- 
prises: first address calculating means for calculating first 
address output values of the signals inside the gray proxi- 
mate region as data of the endpoints of the first interpolation 
unit region; first interpolation weight calculating means for 
calculating the first interpolation weights using the signals 
inside the gray proximate region; and first storing means for 
storing the first address output values obtained by the first 
address calculating means, and wherein the second process- 
ing means comprises: second address calculating means for 
calculating second address output values of the signals 
outside the gray proximate region as data of the endpoints of 
the second interpolation unit region; second interpolation 
weight calculating means for calculating the second inter- 
polation weights using the signals outside the gray proxi- 
mate region; and second storing means for storing the 
second address output values obtained by the second address 
calculating means. 

It is further preferable that the interpolation processing 
means performs the interpolation processing using the first 
address output values stored in the first storing means and 
the first interpolation weights calculated by the first inter- 
polation weight calculating means when the digital color 
signals are discriminated as being present in the gray proxi- 
mate region or perform the interpolation processing using 
the second address output values stored in the second storing 
means and the second interpolation weights calculated by 
the second interpolation weight calculating means when the 
digital color signals are mscriminated as being not present in 
the gray proximate region, thereby obtaining the nonlinear 
processing output values. 

It is also further preferable that the nonlinear processing 
means is three dimensional retrieving table transforming 
means for performing the nonlinear processing using a three 
dimensional retrieving table. 

It is still further preferable that the digital color signals 
comprise three primary color signals of red(R), green(G) and 
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blue(B), wherein the interpolation processing means holds 
output signal values corresponding to each vertex of an cube 
composed of planes perpendicular to red(R), green(G) and 
blue(B) axes as data of the endpoints of the interpolation unit 

5 region in the three dimensional retrieving table, performs an 
interpolation operation of the output signal values corre- 
sponding to each vertex with interpolation weights corre- 
sponding to a position within the cube and wherein the cube 
in proximity of the gray signals, which is present inside the 

10 gray proximate region is rendered smaller in size than the 
cube in a periphery of the three dimensional retrieving table, 
which is present outside the gray proximate region. 
Moreover, it is preferable that a side of the cube in the 
proximity of the gray signals is half or less in the size of the 

is side of the cube in the periphery. Furthermore, it is prefer- 
able that the gray proximate region in the proximity of the 
gray signals is a region where total length from the gray 
signals as a center in each direction of the red, the green and 
the blue axes is within 5 pieces of cubes in the periphery. 

20 Still furthermore, it is also preferable that the nonlinear 
processing means performs at least one nonlinear processing 
of color balance adjustment, lightness correction and con- 
trast correction. 

2S BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing the general layout of 
a color digital printer including an image processing appa- 
ratus according to an embodiment of the invention; 

FIG. 2A is an illustration of embodiments of a bar code 
30 reader and magnetic heads used in a scanner shown in FIG. 
1; 

FIG. 2B is a perspective view showing diagrammatically 
an embodiment of the essential part of the scanner; 
35 FIG. 3A is a perspective view showing diagrammatically 
another embodiment of the essential part of the scanner 
shown in FIG. 1; 

FIG. 3B is a plan view showing diagrammatically an 
embodiment of a line CCD sensor assembly; 
40 FIG. 4 is a block diagram for an embodiment of an image 
processing apparatus shown in FIG. 1; 

FIG. 5 is an illustration (G-R axis) showing an example 
of a divided status of unit cubes for interpolation operations 
in the proximity of gray axis of 3D-LUT used in the 
45 invention; 

FIG. 6 is an illustration (B-R axis) showing an example of 
a divided status of the unit cubes for the interpolation 
operations in the proximity of the gray axis of 3D-LUT used 
in the invention; 

FIG. 7 is an illustration (B-G axis) showing an example 
of a divided status of the unit cubes for the interpolation 
operations in the proximity of the gray axis of 3D-LUT used 
in the invention; and 
55 FIG. 8 is a block diagram showing an embodiment of a 
nonlinear transforming device constructing an LUT conver- 
sion device in a processing subsection in the image process- 
ing apparatus shown in FIG. 4. 

DETAILED DESCRIPTION OF THE 
60 INVENTION 

An image processing apparatus according to the invention 
is hereunder described in detail with reference to the pre- 
ferred embodiments shown in the accompanying drawings. 
65 FIG. 1 is a block diagram showing the general layout of 
a color digital printer including an image processing appa- 
ratus according to an embodiment of the invention. 
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The color digital printer iudicated by 10 in FIG. 1 
comprises a film reading apparatus (scanner) 12 that reads 
photoelectrically the image on a film (color negative film) F, 
an image processing apparatus 14 that performs image 
processing on the thus read image data (image information) 
and with which the color digital printer 10 as a whole 
according to the embodiment under consideration is manipu- 
lated and controlled, and a printer 16 which performs 
imagewise exposure of a light-sensitive material 
(photographic paper) with light beams modulated in accor- 
dance with the image data delivered from the image pro- 
cessing apparatus 14 and which performs development and 
other necessary processing to produce a finished print 
(photograph). 

Connected to the image processing apparatus 14 are a 
manipulating unit 18 having a keyboard 18a and a mouse 
186 for inputting (setting) various conditions, selecting and 
commanding a specific processing scheme and entering a 
command and so forth for effecting color/density correction, 
as well as a display 20 for representing the image captured 
with the scanner 12, various manipulative commands and 
pictures for setting and registering various conditions. 

The above-mentioned scanner 12 is an apparatus with 
which the images recorded on the film F are read photo- 
electrically frame by frame. It comprises a light source 22, 
a variable diaphragm 24, a color filter assembly 26 that has 
three color (R, G, B) filters for separating the image into 
three primary colors R (red), G (green) and B (blue) and 
which rotates to have either one of these color filters inserted 
into the optical path, a diffuser box 28 which diffuses the 
reading light incident on the film F so that it becomes 
uniform across the plane of the film F, an imaging lens unit 
32, a CCD sensor 34 which reads the image in one frame of 
the film, an amplifier 36, an analog/digital (A/D) converter 
37 and a bar code reader 38 that optically reads DX codes 
recorded on the edges of the film F. 

In the illustrated color digital printer 10, dedicated carriers 
are available that can be loaded into the body of the scanner 
12 in accordance with the type or the size of the film used 
(e.g. whether it is a negative or reversal film of 240 or 135 
size), the format of the film (e.g. whether it is a strip or a 
slide), the kind of treatment to be done (e.g. whether it is 
trimming) or other factor. By interchanging carriers, the 
color digital printer 10 can be adapted to process various 
kinds of films in various modes. The images (frames) that 
are recorded on the film F and which are subjected to the 
necessary procedure for print production are transported and 
held in a specified reading position by means of the carrier. 

The bar code reader 38 is provided on the carrier on the 
side upstream of the specified reading position as seen in the 
direction of film transport. It reads DX codes optically as the 
film F is transported to the specified reading position. If the 
film F is of 240 size, the bar code reader 38 also reads 
magnetic information from magnetic tracks. 

FIGS. 2 A and 2B show details of the arrangement of the 
scanner 12 and the bar code reader 38 which is provided on 
the scanner 12 in the color digital printer 10 according to the 
embodiment under consideration. 

The film F is transported intermittently by means of two 
transport roller pairs 44a and 446 that are provided upstream 
and downstream, respectively, of a carrier mask 42 as seen 
in the direction of film transport. The carrier mask 42 has an 
opening 42a that determines the reading position and size of 
the film F. The bar code reader 38 has one optical sensor 38a 
serving as a bar code reader head and a plurality of other 
optical sensors 386; these optical sensors are arranged across 
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the transport width of the film F near the upstream side of the 
transport roller pair 44a which is provided upstream of the 
carrier mask 42 as seen in the direction of film transport. 
Each of the optical sensors 38a and 386 consists of one light 

5 emitting portion 39a and one light receiving portion 396 that 
are spaced by the film F (indicated by a dashed line in FIG. 
2A) which is transported in the film transport path. 

The optical sensor 38a is provided at an end of the width 
of the film F and used to read optical information such as DX 

10 codes; it is adapted to detect not only perforation holes P in 
the film F but also its leading and trailing edges. The optical 
sensors 386 are provided in a face-to-face relationship with 
the middle of the width of the film F and used to detect the 
picture (image) area GA of each of the images recorded on 

15 the film F and the non-picture area between picture areas, or 
so-called frames. Briefly, the optical sensors 386 are used to 
assist in automatic transport of the film F and continuous 
transport and reading of more than one frame using line 
sensors to be described later in this specification. 

20 The magnetic heads 40 are provided on a carrier that is 
compatible with a 240 film F. As shown in FIG. 2B, they are 
provided in a face-to-face relationship with magnetic tracks 
MT on both lateral edges of the film F in positions upstream 
of the bar code reader 38. Each magnetic head 40 comprises 

25 a record head 40a for recording magnetic information on the 
magnetic tracks MT and a read head 406 for reading the 
magnetic information recorded on the magnetic tracks MT. 
The bar code reader 38 and magnetic heads 40 having the 

3Q structures described above are connected to a controller 46 
provided in the scanner 12. The controller 46 is also con- 
nected to motors (not shown) for driving the transport roller 
pairs 44a and 446 on the carrier, various sensors (not shown) 
and solenoids (not shown) for opening or closing the mask 

35 (film holder) 42. As the film F is transported or successive 
frames are fed by means of the transport roller pairs 44a and 
446 under the control of the controller 46, the bar code 
reader 38 reads optical information such as DX codes from 
the film F. At the same time, the record head 40a in each 

^ magnetic head 40 records the magnetic information from the 
controller 46 on the magnetic tracks MT of the Film F as it 
receives information from the image processing apparatus 
14 whereas the read head 406 of each magnetic head 40 
reads the magnetic information recorded on the film F. 

45 The thus read optical and magnetic information are sent to 
the image processing apparatus 14 via the controller 46. The 
DX codes as read with the bar code reader 38 are digitized 
or encoded with the controller 46 and then sent to the image 
processing apparatus 14 where they are acquired as optical 

50 information indicating the type of the film used and the name 
of its manufacturer. 

The reading of optical information with the bar code 
reader 38 and the acquisition of magnetic information with 
the magnetic heads 40 are preferably performed as the film 

55 is transported or successive frames are fed during pre scan 
for coarse reading of the image on the film F. However, this 
is not the sole case of the invention and optical and magnetic 
information may be read or acquired during fine scan or, 
alternatively, they may be read with a separate dedicated 

50 machine. It should be noted that if a bar code reader is to be 
used, the bar codes and the image in one frame of the film 
F are not read simultaneously but the bar codes in a frame 
and the image in a different frame are read simultaneously. 
After the optical information (and magnetic information) 

65 in a frame of the film F has been read with the bar code 
reader 38 (and the magnetic heads 40), the image in the same 
frame is read with the scanner 12. Reading light issued from 
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the light source 22 has its quantity adjusted by the variable reading pixels. On the three CCD arrays, R; G and B niters 

diaphragm 24, passes through the color filter assembly 26 to are superposed to construct the line sensors 48R, 48G and 

be adjusted in color and is diffused by passage through the 48B, respectively. 

diffuser box 28. The reading light with evenly diffused light The color digital printer 10 of the embodiment under 

quantity is then incident on a frame of the film F held in the 5 consideration is supplied with the image data for the image 

specified reading position by the carrier (and which is processing apparatus 14 from the scanner 12 that performs 

hereunder typified by a 135 film) and transmitted through photoelectric reading of the image recorded on films such as 

the frame to produce projected light bearing the image in the negatives and reversals. However, the scanners 12 and 50 

frame as recorded on the film F. are not the sole examples of the source of supplying image 

The projected light from the film F is focused by the 10 data to the image processing apparatus 14 and various kinds 

imaging lens unit 32 to form a sharp image on the light- of image reading apparatuses, imaging devices and image 

receiving plane of the CCD sensor 34. After photoelectric data storage devices may be employed, as exemplified by an 

reading of the image with the CCD sensor 34, the output image reading apparatus that reads the image on a reflection 

signals from the CCD sensor 34 are amplified with the original, a digital camera or a digital video camera, com- 

amplifier 36, converted to digital form in A/D converter 37 15 munication devices such as a local area network (LAN) and 

and sent to the image processing apparatus 14. The CCD a computer communication network (an on-line service 

sensor 34 is typically an area CCD sensor having 1380x920 network), and storage media such as memory cards and MO 

pixels. (magneto-optical) media. 

In the scanner 12, such image reading is performed three As already mentioned, the output signals (image data) 

times, with the respective color filters in the color filter 20 from the scanner 12 are fed into the image processing 

assembly 26 being inserted in succession so that the image apparatus 14. 

in one frame is read as separations of three primary colors FIG. 4 is a block diagram for the image processing 

R, G and B. apparatus 14 (which is hereunder referred to simply as 

In the color digital printer 10 of the embodiment under "processing apparatus 14"). The processing apparatus 14 

consideration, image reading (fine scan) for outputting a generally comprises a control line and an image processing 

print P is preceded by prescan which reads the image at low line. The control line has a CPU 54 that implements and 

resolution for determining the image processing conditions controls the image processing method of the invention and 

and so forth. Therefore, a total of six image reading pro- which also controls and manages, both partly and wholly, 

cesses are performed for one frame. the color digital printer 10 including the scanner 12, pro- 

In the embodiment under consideration, the scanner 12 cessin g apparatus 14 printer 16 and display 20, as well as an 
uses an area CCD sensor and reads the image as separations eternal memory 56 for storing the information necessary to 
of three primary colors of the projected light that are implement the image processing method of the invention 
obtained by the color filter assembly 26. This is not the sole ? nd the color digital printer ia The image process- 
case of the scanner that can be used in the invention and a 35 ^g line has a data processing section 58, a prescan (frame) 
scanner indicated by 50 in FIG. 3A may be substituted; it memory 60, a fine scan (frame) memory 62, a prescanned 
uses a three-line CCD sensor assembly 48 (consisting of jmage processing section 64, a fine scanned image process- 
three line sensors 48R, 48G and 48B) that are adapted for m S sectlon 66 and a condition setting section 68. 
reading the three primary colors R, G and B and performs The processing apparatus 14 also includes devices for 
image reading by slit scan which reads the images on the ^ determining the stop-down value of the variable diaphragm 
film F as it is transported for scan by means of the transport 24 and the charge storage time of the CCD sensor 34 dunng 
roller pairs 44a and 44b on the carrier. Since the scanner 50 fine scan. In the control line, the manipulative unit 18 and 
is capable of simultaneous reading of three colors R, G and me display 20 are controlled by the CPU 54 and connected 
B, each of prescan and fine scan need be performed only to related sites via a CPU bus 80. 

once and regardless of the type of the film F (e.g. whether 45 In the image processing line, the R, G and B signals 

it is a piece or strip of 135 size film or a 240 size film within outputted from the scanner 12 are sent to the data processing 

a cartridge), the image reading process can be simplified by section 58 where they are subjected to various processing 

reciprocal movements. Prescan may be performed by read- schemes such as log conversion, DC offset correction, dark 

ing all frames in succession. correction and shading correction, whereupon digital image 

Thescanner50showninFIG.3AhasessentiaUythesame 50 data is obtamed - 0fthe di S ital imagedata, prescanned 

structure as the scanner 12 shown in FIGS. 1 and 2A and (image) data is stored in the prescan memory 60 and fine 

need not be described in detail. Suffice it here to say that the *»nned (image) data is stored in the fine scan memory 62. 

scanner 50 which performs image reading by slit scan The prescanned data and the fine scanned data are essen- 

substitutes a slit plate 52 (which may be the top cover of the dally the same data except for resolution (pixel density) and 

. carrier) having an elongated slit 52a for the film holder 55 signal level. 

(mask) 32 and uses the line CCD sensor assembly 48 in the prescanned data stored in the prescan memory 60 is 

place of the area CCD sensor 34; the color separating filter processed in the prescanned image processing section 64 

26 is replaced by a light adjusting filter (not shown) with whereas the fine scanned data stored in the fine scan memory 

which the quantity of the light issuing from the light source 62 is processed in the fine scanned image processing section 

22 is adjusted for each color component. 50 

The hne CCD sensor assembly 48 is a three-line reading The prescanned image processing section 64 comprises an 

sensor which performs reading of three primary colors R, G image processing subsection 70 and an image data trans- 

and B almost simultaneously as separations of the projected forming subsection 72 whereas the fine scanned image 

light from the film F and has three line sensors 48R, 48G and processing section 66 comprises an image processing sub- 

48B for reading R, G and B lights, respectively. Each line 65 section 74 and an image data transforming subsection 78. 

sensor is a CCD array arranged in one line the same number In accordance with the image processing conditions set by 
of CCD elements that correspond to the same number of the condition setting section 68 to be described later, preset 
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image processing conditions are read out' of the internal size' of the conventional one, the regiun composed of five 

memory 56 by the CPU 54. The image processing subsec- pieces of unit cubes in each direction of three axes, namely 

tion 70 (which is hereunder referred to simply as "process- R, G and B axes, with the unit cube (in the same size as the 

ing subsection 70") in the prescanned image processing unit cube in the periphery) of the conventional 3D-LUT 

section 64 and the image processing subsection 74 (which is 5 around the gray axis as the center placed in the center, more 

hereunder referred to simply as "processing subsection 74") particularly, two pieces each on opposite sides of one cube 

in the fine scanned image processing section 66 are the sites disposed on the gray axis in each direction of these three 

where the image (image data) read by the scanner 12 are axeg ^ set 

subjected to specified image processing schemes in accor- . . „ , 

dance with either the image processing conditions read by ,„ , In the invention the proxtmity of the gray region where 

the CPU 54 or the image processing conditions that are set 10 thjs ut.it cubejs smaUerm size than usual is not limited to the 

in the condition setting section 68 to which the conditions above described region. A specified region with the gray ax* 

read by the CPU 54 have been sent. The two processing P la ? ed m lts ma y 1x5 »!*«»»% in accordance 

subsections 70 and 74 perform essentially the same opera- ^ ""J""* of ^ "J rod " Ctl0n ',^ r I ^! of ™ lol f 

tions except that the image data to be processed have „ reproduction, accuracy of the adopted 3D-LUT (number of 

different pixel densities. lattice P° mts or end P omls > namelv ' size of unlt mbe 10 lh ° 

_ . . , . . . . periphery, downsized size of unit cube in the proximity of 

The image processing .schemes to be performed m the ^ ujs and ^ ^ and ^ forth Moreover? the region 

processmg subsections 70 and 74 are generally exemplified • f u i . j r ■ 1 i T*u~ 

I ,t, ,• . .T • \ is also optionally selected from a circle, a polygon and the 

by color balance adjustment contrast correc ion (toning), ^ a J form t0 the F / ^ ^ ^ 

hghtness correction dodging (compresston/extension of the 20 ^ ^ ^ fe ? ab , „ d 

dynamic range of densities), chroma correction and sharp- rc . - v , f\ mru^r -*u ;~ „i 

» * - j 7 ' . , - j of 5 pieces of unit cubes of the 3D-LUT with a conventional 

ening. As already mentioned, these schemes are performed . f , .. ... . , , 

, i i j . . , ,f 4 . c size in each direction of three axes with the gray axis placed 

by known methods comprising appropriate combinations of ^ 

arithmetic operations with operation expressions, processing " . . 

operations with LUTs, MTX operations, processing opera- 25 Furthermore, the ratio of sizes (volumes) of the unit cubes 

tions with filters and so forth. In the illustrated example, ™ the proximity of the gray axis and in the periphery is not 

color balance adjustment, Hghtness correction and contrast ^ miXtd to an X specified number in the invention and may 

correction are performed with LUT transforming devices optionally be determined taking various factors into account; 

70a and 74a, while chroma correction is performed with however, for example, the ratio is most preferably 1/8 as 

MTX operating devices 70Z> and 74b. Other schemes such as 30 frustrated. 

sharpening and dodging are performed in blocks 71 and 75 ln ^G. 8, a nonlinear processing device 100 composing 

in accordance with operator's instructions, image data and the above described LUT transforming devices 70a and 74a 

so f or th. and interpolation operation processing to be performed 

In the image processing apparatus 14 of the embodiment therein are shown in detail, 

under consideration, the image processing described above 35 The nonlinear processing device 100 constitutes the LUT 

that is to be performed in the processing subsections 70 and transforming devices 70a and 74a which performs the 

74 is modified such that each of three dimensional retrieving nonlinear processing schemes such as color balance 

tables, namely, 3D-LUTs (three dimensional look-up tables) adjustment, lightness correction, contrast correction and the 

used in the LUT transforming devices 70a and 74a respon- like using 3D-LUTs such as those shown in FIGS. 5 to 7. 

sible for nonlinear processing such as color balance adjust- 40 The nonlinear processing device 100, as shown in FIG. 8, 

ment is configured in a special manner as shown in FIGS. 5 comprises a gray region judging device 101, a first calcu- 

to 7, and the LUT transforming devices 70a and 74a lating device 102, a second calculating device 103 and an 

themselves are configured in a special manner as shown in interpolation operating device 104. The first calculating 

FIG. 8, to prevent the occurrence of extraordinary variations device 102, the second calculating device 103 and the 

in gray signals. 45 interpolation operating device 104 constitute a region cor- 

In other words, as examples shown in FIGS. 5 to 7, LUTs respondent nonlinear processing device which performs a 

used in the invention are utilized for LUT transforming nonlinear transformation (LUT transformation) differendy 

devices 70a and 74a and are 3D-LUTs composed of three corresponding to respective regions which are judged by the 

primary colors of R, G and B. These 3D-LUTs have essen- gray region judging device 101. 

tially the same structures as those of conventional 3D-LUTs 50 In the nonlinear processing device 100 shown in FIG. 8, 

composed of R, G and B axes but differ from the conven- the gray region judging device 101 discriminates more 

tional ones in that the size of the unit cube (unit lattice) accurately than before using each pixel whether the pixel of 

constituting an interpolation unit region in the proximity of interest belongs to the proximity of the gray region or not, 

the gray region including the gray axis itself (gray signals), namely, whether input signals (digital color signals) belong 

that is, the gray proximate region is rendered smaller than 55 to the proximity of the gray region or not. The base for the 

that in other regions, that is, in the periphery of the 3D-LUT, above described discrimination is not limited in a specific 

for example, one eighth or less the size (volume) of the unit manner and may be set in accordance with the establishment 

cube in other regions, that is, half or less the length of a side of the proximity of the gray region. For example, a discrimi- 

of the unit cube in other regions to increase the density of the nation method of comparison with the threshold value preset 

unit cubes in the proximity of the gray axis to a higher level 60 m accordance with the establishment of the proximity of the 

than that in the region apart from the gray axis, thereby gray region or the like may preferably be used, 

increasing accuracy of interpolation operations of input The first calculating device 102 calculates data necessary 

signals (i. e., digital color signals) which are signals inside for interpolation operations to be performed on values of 

the gray proximate region being present in the proximity of input signals subjected to the LUT transformation, for 

the gray region including the gray axis itself. 65 example, the address (position) of endpoints in the interpo- 

In the illustration, as the proximity of the gray region (the la tion unit region including the input signals and position 

gray proximate region) where the unit cube is one eighth the weights of the input signals, when the gray region judging 
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device 101 discriminates Y (Yes), namely, the gray region essentially in the same manner as'" in the first address 

judging device 101 discriminates that the input signals calculating unit 105, reads values after subjected to LUT 

belong to the proximity of the gray region. The first calcu- nonlinear transformation of these eight vertexes from the 

lating device 102 comprises a first address calculating unit 3D-LUT stored in the second memory 109 and sends them 

105, a first memory 106 and a first weight calculating unit 5 to the second memory 109 to be stored therein. When the 

size of the unit cube (shown in dotted lines) m the proximity 

* „ , , . r of the gray axis of the 3D-LUT is one eighth the size of the 

The first address calculating umt 105 calculates, from ^ cube (shown in sobd lines) in the p eripheral region ^ 

upper bits of the input signals which belong to the proximity shown m FIGS 5 , 0 ? me upper bits t0 be }ssed for 

of the gray region (hereinafter called as signals inside the calculation with the second address calculating unit 108 

gray proximate region), interpolation unit region including 10 which target& the un[{ shown in lines m mGS 5 

these signals inside the gray proximate region such as, in the to ? m Qne bit less in number thaD those to be used in the 

illustrated 3D-LUT, endpoints (lattice points) of the unit first a66tess calculating unit 105 which targets the unit cube 

cube including the signals inside the gray proximate region, s h 0 wn in dotted lines. 

preferably all endpoints necessary for interpolation The second memory 109 constitutes 3D-LUTs adaptable 

operations such as eight vertexes of this unit cube as well to ^ ^ of me re ^ on inchld ^ me axis> 

as reads values of these eight vertexes subjected to the LUT m ^ same maQncr as ^ ^ ^ ffl ^ ^ afld 

nonlmear transformation from the 3D-LUT stored in the first ^ ^-IXJT values which have been calculated with the 

memory 106 to send them to the first memory 106 for storing address cakulatin unit m ^ ^ addresses of 

them. As shown m FIGS. 5 to 7 the unit cur^ havmg ei^t aU ^ ^ ^ and subjected tQ 

vertexes calculated in the first address calcaUa^g unit 105 20 (processing). In the case of 

ranges from the same size of the unit cube in the periphery 3D . LUT shown m piGS. 5 to 7, an interval between the 

which is shown in solid lines to one eighth the size of the Ms fead ^ me mem 109 ^ twice the 

unit cube m the periphery which is shown in dotted lines to ^ of ^ fead ^ ^ fifSl m m ^ weight 

be capable of reproducing highly accurate gray. calculating unit 110 calculates the position of the signals 

The first memory 106 constitutes 3D-LUTs adaptable to outside the gray proximate region in the cube subjected for 

the proximity of the gray region including the gray axis as interpolation including the signals outside the gray proxi- 

well as reads and stores 3D-LUT values which have been matc region ^ weights adaptable to respective endpoints of 

calculated with the first address calculating unit 105 and m is cube from the position (address) of the signal outside the 

stored in addresses of all eight endpoints (eight lattice ^ gray proximate region and all the endpoints (addresses) of 

points), namely, LUT values subjected to the nonlinear me cube subjected for interpolation including the position of 

transformation. The weight calculating unit 107 calculates me s ig na ls outside the gray proximate region itself, 

the position of the signals inside the gray proximate region Iq the case of the signals the gray p rox im a te 

in the cube to be subjected to interpolation including the region> the i oterpolal i on operating device 104 multiplies the 

signals inside the gray proximate region as weights adapt- ^ transformed values at respective endpoints stored in the 

able to respective endpoints of this cube from the position memory 106 of the first calculating device 102 by weights 

(address) of the signals inside the gray proximate region and adaptable to respective endpoints on the basis of each 

all the endpoints (addresses) of the cube to be subjected to en dpoint and then obtains the summation of all of the thus 

interpolation including the position of these signals. multiplied values. Namely, in the interpolation calculating 

The second calculating device 103 calculates data neces- ^ device 104, the sum of products of transformed values at all 
sary for interpolation operations to be performed on values mc endpoints and weights at all the endpoints is obtained, 
of input signals subjected to the LUT transformation, for When the summation of weights at all the endpoints calcu- 
example, the address (position) of endpoints in the interpo- i a ted in the weight calculating unit 107 is normalized as 
lation unit region including the input signals and position being 1, the summation of the multiplied values directly 
weights of the input signals, when the gray region judging 45 comes to be interpolation values which are aimed for. On the 
device 101 judges N (No), namely, the gray region judging other hand, when it is not normalized, the summation of the 
device 101 discriminates that the input signals do not belong multiplied values is divided by the summation of the weights 
to the proximity of the gray region. The second calculating to obtain the interpolation values. The thus obtained inter- 
device 103, in the same manner as in the first calculating polation values are the transformed values to be aimed for in 
device 102, comprises a second address calculating unit 108, 5Q me nonlinear transforming device (nonlinear processing 
a second memory 109 and a second weight calculating unit device) 100 and is outputted from the nonlinear transform- 
110. ing device 100 as the output signals. 

The second address calculating unit 108, the second In the above illustration, in the first and second address 

memory 109 and the second weight calculating unit 110 of operating units 105 and 108, all of eight vertexes of the unit 

the second calculating device 103 have essentially the same 55 cube including the input signals are obtained; however, at 

structures as those of corresponding units in the first calcu- least one vertex, its length and direction (direction or incli- 

lating device 102, namely, the first address calculating unit nation of increase/decrease) of its side may be obtained. 

105, the first memory 106 and the first weight calculating Moreover, in the first and second weight calculating units 

unit 107 except for data amounts or densities to be subjected . 107 and 110, weights adaptable to all of eight vertexes of the 

Therefore, detailed explanation on these units of the second 60 unit cube are obtained; however, the weight to the direction 

calculating device 103 is omitted. along each of R, G and B axes from at least one vertex may 

The second address calculating unit 108 calculates, from be obtained. The above are illustrative examples and the 

upper bits of the input signals which do not belong to the vertex and weight may be obtained in accordance with any 

proximity of the gray region (hereinafter called as signal adaptable interpolation methods. Any known interpolation 

outside the gray proximate region), eight endpoints (eight 65 methods are adaptable also to the invention, 

lattice points) of the unit cube which will be interpolation In the above examples, the first and second memories 106 

unit regions including these signals outside the gray region and 109 constitute 3D-LUTs from which the first and second 
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address calculating units 105 and 108 read' the ' values' B which* are denser than those used io the above calculation 
transformed with these 3D-LUTs. The invention is not in the second calculating device 103 to perform the inter- 
limited to the above method and the first and second polation operations in the interpolation operating device 104 
memories 106 and 109 may not constitute an LUT and be using the transformation data stored in the first memory 106 
portions to store only addresses of all of eight endpoints 5 corresponding to the thus calculated address and the weights 
calculated in the first and second address calculating units calculated in the first weight calculating unit 107. Calcula- 
105 and 108 whereupon the interpolation operating device tions in & c first calculating device 102 are corresponding to 
104 reads transformed values of addresses of all of the small unit cubes as shown in dotted lines in FIGS. 5 to 7 so 
endpoints stored in the first and second memories 106 and mat . mterpolation operations are performed using vertex 
109 with reference to 3D-LUTs which are either of a built-in to SSf^^^™" 11 * ^ 
type or of an external type to obtain the sum of products of 3 r 0n ° p6 ? 1Dg evicc • 

t he thus read transformed values of addresses of all of the '. n *" ^oye case, the atove-described first and second 

, . . 4 . . * j [« it f *t_ « . weight calculating units 107 and 110 perform weighting 

endpomts and ^e weights adaptable to all of the endpoints calc * u]ation of Called cube interpolation (volumt 

calculated in the first and second weight calculating units mterpolation) m which weights corresponding to a distance 

107 and 110. 15 to each of ^ q ^ g axis within the gray proximate region 

At the above example, in the nonlinear transforming are preset, 
device 100 which constitutes the LUT transforming devices i n other words, in the present embodiment, in order to 
70a and 74a, the interpolation values are obtained by obtain the output signals corresponding to the input signals 
volume interpolation using 3D-LUT composed of three in accordance with outputs from the above-described first 
axes, that is, R, G and B axes. The invention is not limited 20 and second calculating devices 102 and 103, the interpola- 
te the above method and, if accuracy is sufficiently ensured, tion operating device 104 performs the interpolation opera- 
^Uhe interpolation values may be obtained by a straight-line, tions using vertex position addresses of either large unit 
\ interpolation using a one-dimensional (1D-) LUT of each of cubes as usual when the input signals are judged as not 
\ R, G and B axes as a LUT as well as using a segmento ffige belonging to the proximity of the gray region or small unit 
I and both endpoints of it as an interpolation unit region 25 cubes which are denser than usual when the input signals are 
f induding the inpul signals and its endpoints. In another case, i^ZF* ™ belonging to the proximity of the gray region to 
^one-dimensional (ID-) LUT of anyone axis of R, G and B P.^ 0 ™ preferable °olor balance adjustment. The output 
axes and two-dimensional (2D-) LUT of the remaining axes ^ nals * be u out P ulted from f he f erpolanon °P^S 

are used as LUTs whereupon, in the case of ID-LOT, the d ^ vlc f , , bcc ° meS ° ut P ut T^T? 1 Preferably 

. . . , \ . , « « , . '.. , n adjusted color balance to be outputted from the nonlinear 

interpolation values are obtained as well by the straight -line 3V . r • a * inn a • * - u t >u« 

^\ . ■ i ^ i i transforming device 100 and is outputted from each of the 

interpolation w hile, in the case of 2D-LUT, the interpolation LUT transforming devices 70a and 74a. 

values ma7Be obtained by volume interpolation using, for ^ t QU d from me LUT transforming 

example, a square and its four vertexes as the interpolation deviccs 70fl ^ 14a arc sent to operating devices 7Qb 

umt re S l0n eluding themput signals and.its endpoinK and ?46 respcclivcly whcre output signals are subjectcd t0 

The nonlinear transforming device 100 composing the chroma correction as described above. These operation 

LUT transforming devices 70a and 74a is essentially con- results from respective MTX operating devices are sent to 

stituted as above. Its operation is now described below. blocks 71 and 75 respectively where not only sharpening 

In the nonlinear transforming device 100 as shown in FIG. and dodging but also image correction or the like in accor- 

8, the interpolation operation is performed in the interpola- ^ dance with operator's instructions, image data and the like 

tion operating device 104 based on either one of the fol- is performed. 

lowing values depending on the result of discrimination by The image data transforming subsection 72 in the pres- 
ume gray region judging device 101: the values calculated by canned image processing section 64 is a site where the 
the first calculating device 102 when the input signals are above-described image data obtained by processing with the 
judged as belonging to the proximity of the gray region and 45 processing subsection 70 is transformed with a three- 
the values calculated by the second calculating device 103 dimensional (3D) LUT or the like into image data that 
when the input signals are judged as not belonging to the corresponds to the representation on the display 20. The 
proximity of the gray region. image data transforming subsection 78 in the fine scanned 
In other words, when the input signals are judged as not image processing section 66 is a site where the image data 
belonging to the gray proximate region, the second calcu- 50 obtained by processing with the processing subsection 74 is 
lating device 103 calculates an address from upper bits of R, similarly transformed with a 3D-LUT into output image data 
G and B in the second address calculating unit 108 in the that corresponds to image recording with the printer 16, to 
similar way as in the case of the ordinary 3D-LUT to which it is subsequently supplied. 

perform the interpolation operation in the interpolation The various conditions for the processing to be done by 

operating device 104 using transformation data stored in the 55 the prescanned image processing section 64 and the fine 

second memory 109 corresponding to the thus calculated scanned image processing section 66 are set by the condition 

address and the weights calculated in the second weight setting section 68. 

calculating unit 110. Calculations in the second calculating The condition setting section 68 comprises an image 

device 103 are corresponding to large unit cubes as shown processing condition setting subsection 82, a key correcting 

in solid lines in FIGS. 5 to 7 so that the interpolation 60 subsection 84 and a parameter coordinating subsection 86. 

operations are performed using vertex position addresses of The image processing condition setting subsection (which 

these large unit cubes in the interpolation operating device & hereunder referred to as "setting subsection") 82 selects 

1^4 the image processing schemes to be performed; in addition, 

On the other hand, when the input signal is judged as it uses the prescanned data to set the conditions for the image 

belonging to the proximity of the gray region, the first 65 processing schemes to be done in the processing subsections 

calculating device 102 calculates in the first address calcu- 70 and 74 and supplies them into the parameter coordinating 

lating unit 105 an address from the upper bits of R, G and subsection 86. 
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Specifically, ihe setting subsection 82 uses the prescanned When the prescauned data is stored in Lhe prcscau 

data to perform various operations including the construe- memory 60, the setting subsection 82 reads it out of the 

tion of density histograms and calculation of various image prescan memory 60, constructs density histograms, calcu- 

characteristic quantities such as average density, large-area lates image characteristic quantities and performs any other 

transmission derisity (LATO), higWights (minimum density) 5 necessary operations to set image processing conditions 

and shadows (maximum density). In addition, in response to (construct LUTs and MTXs) and send them to the parameter 

an operator's instruction that is optionally entered from the coordinating subsection 86. 

manipulative unit 18, the setting subsection 82 determines . . . . 4 4 . „ . . - , 

r . & i-c j u .u . Id parallel with these steps, the stop-down value of the 

image processing conditions as exemplified by the construe- ~* . . ■ <• ^ 

tion of tables (LUTs) for performing gray balance 1A variable o^aphragm 24 and other reading conditions for fine 

adjustment, lightness correction and contrast correction and 10 scan j arc determined and otherwise set so that the scanner 12 

the construction of matrix operational formulae for perform- ^ adjusted accordingly. Then, the scanner 12 performs fine 

ing chroma correction. scan m ^ me ^ ne scanned data are sequentially transferred 

The key correcting subsection 84 calculates the values of for stora S e m the ^ scaD memory 62. 
adjustment of image processing conditions (e.g. the values u P° n receiving the image processing conditions, the 
of correction of LUTs) typically in accordance with various 15 parameter coordinating subsection 86 sets them at specified 
instructions entered by means of keys on the keyboard 18a sites (hardware) in the processing subsection 70 of the 
for adjusting the lightness, color, contrast, sharpness, prescanned image processing section 64 and in the process- 
chroma and so forth or by the mouse 186; the key correcting m g subsection 74 of the fine scanned image processing 
subsection 84 then supplies the calculated values of adjust- section 66. 

ment into the parameter coordinating subsection 86. Subsequently, the prescanned data is read out of the 
After receiving the image processing conditions that have prescan memory 60, processed in the processing subsection 
been set by the setting subsection 82, the parameter coor- 70 under the already set conditions and transformed in the 
dinating subsection 86 sets them in the processing subsec- image data transforming subsection 72 to image data cor- 
tion 70 of the prescanned image processing section 64 and responding to the representation on the display 20. The 
in the processing subsection 74 of the fine scanned image prescanned image that has been thusly subjected to specified 
processing section 66. Further, in accordance with the values processing is represented on the display 20. 
of adjustment calculated by the key correcting subsection In the ordinary process of print preparation, the operator 
84, the parameter coordinating subsection 86 either corrects looks at the representation on the display 20, checks 
(adjusts) me image processing conditions set in various parts 3Q (verifies) the image, or the result of the processing and, if 
or makes another setting of image processing conditions. necessary, manipulates the aforementioned adjustment keys 
If, in the scanner 12, DX codes are read with the bar code on the keyboard 18a or the mouse lSb to adjust the color/ 
reader 38 and encoded with the controller 46 or if the density, gradation and other features of the image, 
projected light from the film F is read and digitized with the The inputs for this adjustment are sent to the key correct- 
CCD sensor and thereafter sent to the image processing 35 ing subsection 84 which, in response to the entered inputs 
apparatus 14, the CPU 54 reads the film type and the for adjustment, calculates the values of correction of the 
corresponding image processing conditions from the image processing conditions and sends them to the param- 
memory 56 and supplies them into the parameter coordinat- eter coordinating subsection 86. In response to the supplied 
ing subsection 86 in place of the image processing condi- values of correction, the parameter coordinating subsection 
tions that are set by the aforementioned setting subsection ^ 86 corrects the LUT transforming devices 70a, 74a and 
82. MTX operating devices 706, 74£» for performing processing 
In the case just described above, the setting subsection 82 operations capable of reproducing the gray in a stable 
may or may not set image processing conditions. If the manner in the processing subsections 70 and 74 as already 
image processing conditions that are set in accordance with described above. In response to this corrective measure, or 
the information about the film type are to be substituted for 45 & c inputs for adjustment entered by the operator, the image 
the image processing conditions that are set by the setting represented on the display 20 also varies, 
subsection 82 on the basis of the acquired image data, the If the operator concludes that the image being represented 
first mentioned image processing conditions may be direcdy on the display 20 is appropriate (verification OK), he or she 
supplied into the processing subsection 70 of the prescanned manipulates the keyboard 18a or the mouse 186 to give a 
image processing section 64 and the processing subsection 50 command for print start. As a result, the image processing 
74 of the fine scanned processing section 66 so that they are conditions are finalized and the fine scanned data is read out 
set in those processing subsections, eliminating the need to of the fine scan memory 62 and sent to the fine scanned 
set image processing conditions by the condition setting image processing section 66. 

section 68. If no image verification is to be performed, the image 

We now describe the color digital printer 10 of the 55 processing conditions are finalized at the point of time when 

embodiment under consideration in greater detail by the parameter coordinating subsection 86 ends setting of the 

explaining the actions of the image processing apparatus 14. image processing conditions in the processing subsection 74 

The operator sets the film F (or the frame to be subjected of the fine scanned image processing section 66; the fine 

to image reading) in a specified position on the scanner 12 scanned data is then read out of the fine scan memory 62 and 

(or the carrier), completes specified jobs including the entry 60 sent to mc fine scanned image processing section 66. 

of the necessary information such as the size of the prints to Whether verification should be performed or not is pref- 

be prepared, and thereafter keys in a command for starting erably determined by selection of operative modes and so 

print preparation. In response to the START command, the forth. 

scanner 12 starts prescan and, as already mentioned, the When the image data has been thusly read out to the fine 

image recorded on the film F is captured photoelectrically as 65 scanned image processing section 66, it is processed as 

R, G and B separations and output to the prescan memory described above in the LUT transforming device 74a and 

60. MTX operating device 74b of the processing subsection 74 
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and "subjected to other known necessary image processing 
schemes in the processing portion of the block 75; thereafter, 
the image data is sent to the image data transforming 
subsection 78, where it is transformed to image data that is 
suitable for image recording by the printer 16 to which it is 5 
then sent. 

The printer 16 exposes a light-sensitive material 
(photographic paper) in accordance with the image data to 
record a latent image on it and develops and performs other 
treatments suitable for the light-sensitive material to output 10 
it as a (finished) print. To give one example of the printer's 
operation, the light-sensitive material is cut to a specified 
length in accordance with the size of the final print; 
thereafter, the printer records a back print and three light 
beams for exposure to R, G and B that are determined by the 15 
spectral sensitivity characteristics of the light-sensitive 
material are modulated in accordance with the image data 
(the image to be recorded); the three modulated light beams 
are deflected in the main scanning direction while, at the 
same time, the light-sensitive material is transported in the 20 
auxiliary scanning direction perpendicular to the main scan- 
ning direction so as to record a latent image; the latent image 
bearing light-sensitive material is subjected to a specified 
wet development process comprising color development, 
bleach-fixing and rinsing; the thus processed light-sensitive 25 
material is dried to produce a finished print; a plurality of 
prints thus produced are sorted and stacked. 

While one embodiment of the present invention has been 
described above, it should be noted that the invention is by 

30 

no means limited to that embodiment only and various 
improvements and modifications may of course be made 
without departing from the scope and spirit of the invention. 

For example, the number of cubes which define the gray 
proximate region, that is, the proximity of the gray axis as 3S 
shown in FIGS. 5 to 7 is not limited to 5. Moreover, the 
number of division of the cube in the proximity of the gray 
axis is not limited to 8 (i.e., the cube is divided into eight.) 
but may be larger than 8. Furthermore, the divided number 
of the cubes in the proximity of the gray axis may increases 4Q 
in the region closer to the gray axis and decreases in the 
region apart from the gray axis. 

One modification relates to the image data to be input to 
the image processing apparatus of the invention and besides 
inputting the image as read photoelectrically from a photo- 45 
graphic film, input image data from, for example, a digital 
camera and various other digital data supply sources may be 
advantageously used. 

As described above in detail, the present invention pro- 
vides an image processing apparatus that realizes a three- 50 
dimensional retrieving table (3D-LUT) which does not 
cause subtle variations different from its aim (untargeted) 
only with a small addition of memory capacity to the 
ordinary memory, thereby ensuring that the gray reproduc- 
tion can be performed consistently and that photographic 55 
prints of high quality are produced in succession. 

What is claimed is: 

1. An image processing apparatus having nonlinear pro- 
cessing means for performing nonlinear processing on digi- 
tal color signals, 60 
said nonlinear processing means comprising: 

gray region discriminating means for discriminating 
whether said digital color signals are present in a 
gray proximate region including gray signals; and 
region correspondence nonlinear processing means for 65 
performing the nonlinear processing differently in 
accordance with cases where said digital color sig- 
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uals are discriminated as signals inside the gray 
proximate region being present in the proximity of 
said gray signals or as signals outside the gray 
proximate region being not present in the proximity 
of said gray signals by said gray region discriminat- 
ing means. 

2. The image processing apparatus according to claim 1, 
wherein said region correspondence nonlinear processing 
means comprises: 

first processing means for calculating endpoints of a first 
interpolation unit region including said signals inside 
the gray proximate region as well as first interpolation 
weights of said signals inside the gray proximate 
region; 

second processing means for calculating endpoints of a 
second interpolation unit region including said signals 
outside the gray proximate region as well as second 
interpolation weights of said signals outside the gray 
proximate region; and 

interpolation processing means for performing interpola- 
tion processing using the endpoints of said first inter- 
polation unit region and said first interpolation weights 
which have been calculated by said first processing 
means to obtain nonlinear processing output values of 
said signals inside the gray proximate region or for 
performing another interpolation processing using the 
endpoints of said second interpolation unit region and 
said second interpolation weights which have been 
calculated by said second interpolation processing 
means to obtain nonlinear processing output values of 
said signals outside the gray proximate region. 

3. The image processing apparatus according to claim 1, 
wherein 

said first processing means comprises: 

first address calculating means for calculating first 
address output values of said signals inside the gray 
proximate region as data of the endpoints of said first 
interpolation unit region; 

first interpolation weight calculating means for calcu- 
lating said first interpolation weights using said, 
signals inside the gray proximate region; and 

first storing means for storing said first address output 
values obtained by said first address calculating 
means, and wherein 

said second processing means comprises: 

second address calculating means for calculating 
second address output values of said signals 
outside the gray proximate region as data of the 
endpoints of said second interpolation unit 
region; 

second interpolation weight calculating means 
for calculating said second interpolation 
weights using said signals outside the gray 
proximate region; and 

second storing means for storing said second 
address output values obtained by said second 
address calculating means. 

4. The image processing apparatus according to claim 3, 
wherein said interpolation processing means performs the 
interpolation processing using the first address output values 
stored in said first storing means and the first interpolation 
weights calculated by said first interpolation weight calcu- 
lating means when said digital color signals are discrimi- 
nated as being present in said gray proximate region or 
perform the interpolation processing using the second 
address output values stored in said second storing means 
and the second interpolation weights calculated by said 
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second interpolation weight calculating means" when said 
digital color signals are discriminated as being not present in 
said gray proximate region, thereby obtaining said nonlinear 
processing output values. 

5. The image processing apparatus according to claim 1, 5 
wherein said nonlinear processing means is three dimen- 
sional retrieving table transforming means for performing 
the nonlinear processing using a three dimensional retriev- 
ing table. 

6. The image processing apparatus according to claim 5, 10 
wherein said digital color signals comprise three primary 
color signals of red, green and blue, wherein said interpo- 
lation processing means holds output signal values corre- 
sponding to each vertex of an cube composed of planes 
perpendicular to red, green and blue axes as data of the 15 
endpoints of said interpolation unit region in said three 
dimensional retrieving table, performs an interpolation 
operation of the output signal values corresponding to each 
vertex with interpolation weights corresponding to a posi- 
tion within said cube and wherein said cube in proximity of 
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said gray signals, which is present inside said' gray proxi- ' 
mate region is rendered smaller in size than the cube in a 
periphery of said three dimensional retrieving table, which 
is present outside said gray proximate region. 

7. The image processing apparatus according to claim 6, 
wherein a side of the cube in the proximity of said gray 
signals is half or less in the size of the side of the cube in said 
periphery. 

8. The image processing apparatus according to claim 6, 
wherein said gray proximate region in the proximity of said 
gray signals is a region where total length from said gray 
signals as a center in each direction of the red, the green and 
the blue axes is within 5 pieces of cubes in said periphery. 

9. The image processing apparatus according to claim 1, 
wherein said nonlinear processing means performs at least 
one nonlinear processing of color balance adjustment, light- 
ness correction and contrast correction. 

***** 
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